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I. INTRODUCTION 



The growing interest to non-classical entropies in recent years |T], |2| is motivated by the 
fact that they can be used to describe observable statistical effects such as: (i) Non-classical 
tails of distribution functions which can deviate significantly from Gaussian distribution. In 
particular, this asymptotics can be power-law ("long tails") or, instead, distribution func- 
tions can decay in a more rapid fashion ("short tails"), in particular, they can become equal 
to zero at finite distance ("cut tails"), (ii). Strong correlations between subsystems in equi- 
librium and conditionally-equilibrium (quasi-equilibrium) states, (iii) In particular, even at 
a vanishingly weak interaction between subsystems, when the classical Boltzmann-Gibbs- 
Shannon entropy (BGS) would lead to no correlations, strong correlations can be observed in 
the equilibrium. This may sound somewhat paradoxal: Joining non-interacting subsystems 
with equal values of the intensive quantities, and switching on an infinitesimal weak interac- 
tion, we produce a strongly correlated equilibrium. However, the simplest example is readily 
provided (though not related to non-classical entropies per se) by the microcanonical en- 
semble of finite systems: If subsystems are not interacting at all, then there is an additional 
conservation law, the energies of the individual subsystem, and the product of the micro- 
canonic distributions is the equilibrium. However, an arbitrarily weak interaction will surely 
destroy this conservation law, and the equilibrium becomes the usual microcanonic ensemble 
(the equipartition over the surface of constant total energy). For finite number of particles 
in the subsystems, this latter state is correlated, and it does not factor into the product of 
the microcanonical distributions of the subsystems. It is only in the thermodynamic limit 
where the theorem about the equivalence of the ensembles @ states the tendency to zero 
of correlations of (almost) noninteracting subsystems (in the domain of its applicability, of 
course). We should remark that empirically found asymptotics of the distribution functions 
should be always treated with care since they can turn out to be "intermediate asymptotics" 
rather than true limits. 

The entropic description of all these effects in the spirit of Gibbs ensembles is technically 
advantageous (same as any variational principle) but this is by far not the only merit. If the 
entropy is consistent with the kinetics, and varies monotonically in time, then a very useful 
construction becomes available. This is the conditional equilibrium (or quasi-equilibrium, 
with local equilibrium as a specific example). The quasi-equilibrium describes partially re- 
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laxed systems, according to the idea of the fast-slow decomposition of motions: Fast variables 
have almost reached equilibrium at almost fixed values of slow variables. Conditional equi- 
librium is described as the probability distribution which brings to maximum the entropy 
S(p) at fixed values of the slow variables, M = m(p): 

S(p) — ■> max, m(p) = M. (1) 

Usually, when one attempts to introduce non-classical entropies in order to use these 
advantages, there is a price to be paid. Non-classical entropies at use in most of the contem- 
porary studies violate at least one of the following important and familiar properties of the 
BGS entropy: (i) Additivity: The entropy of the system which is composed of independent 
subsystems equals the sum of the entropies of the subsystems, (ii) Trace-form: The entropy 
is a sum over the states (see below), (iii) Concavity of the entropy. For example, the Tsallis 
entropy [Q is not additive, the Renyi entropy Q is not of the trace form. 

Violation of additivity cannot be motivated by the fact that "in reality, all subsystems are 
interacting" |J. Indeed, the additivity axiom is the conditional statement: If the systems 
are independent, then the entropy of the joint system equals the sum of the entropies of 
subsystems. Probability theory, even when studying whatever strongly dependent events, is 
based on such notions as independence, independent trials etc ||. Giving up these notions 
simply on the grounds that events in nature depend on each other is misleading. 

In this paper we demonstrate how the description of both long and short tail distributions, 
growth of correlations etc can be achieved on the basis of the entropy approach, and without 
a violation of neither the additivity nor of the trace form requirements (however, with a 
violation of the concavity only for the description of cut tail distributions). Such a description 
becomes available only if one uses a one-parametric family of entropies introduced recently 
0. We establish analytic formulae for conditional maximizers of these entropies which 
makes operations within the present formalism almost as easy as in the case of a Gaussian 
distribution pertinent to the BGS entropy. 

II. ADDITIVE TRACE-FORM ENTROPIES FOR MARKOV PROCESSES 

The basic model we consider here is the finite Markov chain (finiteness and discreteness are 
by no means the crucial restriction, and are employed only in order to avoid the convergence 
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questions). The time evolution of the probabilities pi, where i is the discrete label of the 
state, is given by master equation, 



Pi — ^ hj ( — j , ky — kji > 0. (2) 

We consider only systems which allow for a positive equilibrium, p* > (for infinite systems, 
it is often advantageous to use unnormalized p*). We recall 0, f| that, for each convex 
function of one variable, h(x), one constructs the Lyapunov function Hh(p) which does not 
increase on solutions to Eq. @, where 

H h (p) = Y^pth(pi/^). (3) 

i 

[We consider below if/j-functions rather than entropy functions Sh = —H^.] 

Among the set of Lyapunov functions (§), there exists a one-parametric subset of additive 
Lyapunov functions, H a , > a > 1: 

H a = ^2p*h Q (pi/p*), 

i 

h a (x) = (1 — a)x\nx — a lnx. (4) 

In particular, 

i 

Hi = -^Mft/jf). 

i 

Additivity of functions H a (|) is readily checked [0, §: If p — Pij = qiTj, and also if 
P* = P*j = 1i r j, tnen 

H a (p)=H a (q) + H a (r). 

It can be demonstrated that the family is unique (up to a constant factor): There are 
no other additive trace-form functions among Lyapunov functions @ of master equation. 

III. SOLUTION TO THE MAXIMUM ENTROPY PROBLEM 

Since a factor in front of H a is irrelevant, it proves convenient to use a different parame- 
terization of the family ([J), 

H a = Y^lPi MPi/Pi) ~ a P* MPi/P*)}> ( 5 ) 

i 
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where a > 0, and where the case a — > oo should be considered separately, 

h 00 = -J2p1Hp/p:)- (6) 

i 

In order to address the construction of the quasi-equilibrium in a general setting, we assume 
the macroscopic variables M = m(p), where M s = Y^i m siPi} an d consider the problem ([!]) 
with S = —H a . Solving this problem with the method of Lagrange multipliers, we find: 

where Lagrange multiplier Ao corresponds to normalization, and A s to the rest of the con- 
straints. Let us denote — Aj the right hand side of Eq. (^). With this, Eq. (^) may be 
written, 

HPiM) - a{P*/Pi) = ~K (8) 

Solution to an equation, 

lng - aq' 1 = -A, (9) 

may be written as follows: 

g = e - A e lm ( QeA ), (10) 

where we have introduced notation lma (modified logarithm) for the function which is the 
solution to the transcendent equation, 

xe x = a. 

The function lm satisfies the following identities: 

lma = In a — In lma, (11) 
lma = In a — ln(lna — ln(lna — ln(. . . )) . . . ). (12) 

Identity (0) is the recurrent application of identity ([□]). A different representation of 
solution ( |T0[ ) reads: 

g= M^J- (13) 

From the representation (|T0"D, the asymptotics at a — >• 0, and fixed A, is obvious: q e _A , 
and which corresponds to the usual Boltzmann distribution. On the other hand, represen- 
tation (|13D reveals the asymptotics at A — » oo: 

a 



In a + A ' 
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For a symmetric distribution on the axis, and for A = Ao + X2X 2 , the first of the limits 
just mentioned gives the Gaussian distribution, while the second limit gives the Cauchy 
distribution. The corresponding distribution function for the limiting case is simply the 
Cauchy distribution on the axis. Among non-symmetric Cauchy distributions of the form, 
V — (-^o + \ x + ^x 2 ) 1 , there are distinguished cases with a twice degenerated zero in 
the denominator: p = (X(x — a)) -2 . When one attempts to normalize this distribution by 
choosing a convergent sequence of functions, one gets a Dirac 5-function, 5(x — a) which can 
be interpreted as a microcanonic ensemble. 

Thus, the quasi-equilibrium distribution has the form: 

p = p * c -A e K«^ )= (14) 
lm(ae A ) 

[We have omitted indices of states in p, p*, and A.] Formula (|14D is the main result of this 
paper. 

It is also interesting to address the formal extension of the result ([14]) to negative a. 
Function lma is defined and is continuous for a > — e _1 (lma > — 1). At a — > — e _1 , we have 
the limit, dlma/da — ► 00. If we formally extend, lma = —00 for a < — e _1 , then Eq is 
a distribution with "cut tail". With this, there will be defined a non-zero ratio p/p*\ 

mi{p/p*\p^0} > \a\ > 0, (15) 

that is, either p > \ac\p*, or p = 0. This construction is similar to a Maxwell construction of 
a stretched spinodal (the cut at the inflection point), and not to the global maximum of the 
entropy. Whereas such constructions are always necessary when working with non-convex 
thermodynamic potentials, will not further discuss the case a < in this paper. 



IV. QUASI-EQUILIBRIUM ENSEMBLES NEAR THE BGS LIMIT 

For the classical BGS entropy (a = 0), the quasi-equilibrium distribution has the form: 

p = p* e - A , (16) 

where A is the corresponding gradient of the entropy at the quasi-equilibrium, expressed in 
terms of Lagrange multipliers. Let us study the quasi-equilibrium fll4|) for small a. To the 
first order, we get: 

p = p* (e~ A + a) +o(a). (17) 
6 



[Note that, in this expansion, dependence of A on the values of the macroscopic variables 
M is implicit. Explicit evaluation of this dependence requires, in addition, an expansion of 
A in terms of a which is used below when studying concrete examples.] 

Substituting equation flT7| ) into the kinetic equation (Markov chain in the present context, 
into the Liouville equation in the context of particle's dynamics, or, generally speaking, into 
the linear equation of the microscopic Markovian process), we easily see that the term ap* 
gives no contribution to the resulting quasi-equilibrium dynamics. Indeed, we first notice 
that the relation between the time derivative p with the Lagrange multipliers is the same, 
as for the classical Boltzmann's distribution fll6|): If L is the linear operator of Markovian 
dynamics, p = Lp, then, substituting for p on the right hand side of this equation the 
expression ([17]) , and using linearity, we get 

L(p* (e- A + a))=L(p*e- A ). 

Furthermore, defining the shifted macroscopic variables, M a = m(p — ap*), we find that 
for the classical quasi-equilibrium dynamic equation, dM/dt = m(Lp(M)), where Lp(M) 
is the microscopic vector field evaluated at the classical quasi-equilibrium states p(M) = 
p* exp(— A(M )) is affected only by a shift M — > M a , to the first order in a. In other words, 
the quasi-equilibrium dynamics of the ensemble ( |14D is driven by the classical dynamics 
resulting from the BGS entropy and Boltzmann distributions ([IB]) to the first order in a. 

In order to compute the quasi-equilibrium to second order in a, we must use the expansion 
of lma to third order, 

lma = a - a 2 + (3/2)a 3 + o(a 3 ). 

Then 

p = p* ( e - A + a --a 2 e A ) +o(« 2 ). (18) 
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Further corrections can also be easily computed using higher-order terms in the expansion 
of the lm. We now shall consider a specific example of the formula ([18]). 



V. EXAMPLE: ENHANCEMENT OF PARTICLE'S CORRELATIONS 

In order to illustrate the effect of second order deviations from the BGS case, we apply Eq. 
(|18|) to the classical quasi-equilibrium defined by the one-particle configurational distribution 
function /i(r), where r is position variable. Assuming, as usual, the equipartition for the 
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reference equilibrium, p* = 1 /V , where V is the volume of the system, and N is the number 
of particles, we get e _A = e x ° YliLi ^( r «); where Lagrange multiplier Ao is responsible for 
normalization. Then the iV-body quasi-equilibrium distribution function to second order in 
a reads, 

N 2 

V N p = e Xo T\q( ri )+a % + o(a 2 ). (19) 
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Our goal now is to compute the two-body configurational distribution function, 
/ 2 (r, q) = N(N - 1) / p(r, q, r 3 , . . . , r N )dr 3 . . . dr Nl 



in the quasi-equilibrium (p~9|) . We recall that the classical result for the BGS entropy gives the 
uncorrelated two-body distribution, / 2 (r, q) ~ fi{r)fi(q), which also corresponds to the limit 
(a = 0) of Eq. ( |T9"D . Computation to the order a 2 requires expansion of Lagrange multipliers 
A and \l/ to the corresponding order. This computation is straightforward although tedious, 
thus we give here only the final result: The two-body quasi-equilibrium configurational 
distribution function / 2 reads: 



A -f 2 (r, q) = (l + a + a 2 ) / x (r) h(q) + an 2 - ^-n 2 B N Vl (r) Vl (q) + o(a 2 ), (20) 



TV — 1 ^' y ,J y /J yi/ 2 



where n = N/V is the average number density, and where we have introduced notation, 

AM = AW -an, (21) 

Mr) = MO - " (22) 
n Bfi(r) 

B = vLm dr - (23) 

It is readily checked that the result ( p0|) gives / 2 = (N — l)A^ _1 /i/i at a = which is 
identical with the classical uncorrelated pair distribution with correct normalization [[J. 

The first two terms in Eq. ( |2"0"D amount again to the uncorrelated state with homogeneously 
shifted one-particle distributions (fi (|2l|) instead of fi, which amounts to a homogeneous 
subtraction of the average density times a). The underlined term (of the order of a 2 ), is the 
contribution responsible for correlations due to the use of the non-classical entropy. It also 
has a form of a product, but not of the distribution functions, rather, of functions of one 
variable (|22|). In order to see the effect of this term more explicitly, we assume 

/ 1 (r)=n(l + C(r)iV- 1 /2) ) (24 ) 



where ( is a function with zero average, and finite amplitude, (() = 0, (( 2 ) = a 2 , where we 
have introduced notation for averaging over the volume, (h) = V~ x j v hdr. Assuming large 
(but finite) number of particles, we find to the leading order in N: 

B = l + a 2 N~ l + o{N~ l ), B N = + o(l). 

Thus, 

N ~ 2 

-h{r,q) ~ (1 + « + « 2 )/i(r)/i(g) + an 2 -2a 2 n 2 a 2 e a N- l 6{r)6{q), (25) 



N -V 

where we have denoted 9 = cr C> (8 2 ) = 1. This correlation is negative once the sign of 
the deviations from the homogeneity at points r and q are the same, and positive if these 
deviations have the opposite signs. 



VI. CONCLUSION 



Once a classical statistical system is out of the thermodynamic limit, the exclusive char- 
acter of the Boltzmann-Gibbs-Shannon entropy is fading away, and classical ensembles are 
not equivalent anymore. Whereas using the microcanonical ensemble for any description 
of finite systems may be most appropriate, this route is very complicated, at least from 
a computational standpoint. For that reason, seeking an entropic description of effects of 
finiteness is a relevant option. 

We stress it once again, that the one-parametric family H a , Eq. @ and (||), is the 
unique generalization of the classical Boltzmann-Gibbs-Shannon entropy consistent with 
the additivity and the trace-form requirements simultaneously. It is reasonable therefore to 
study its applicability to a description of statistical systems out of the strict thermodynamic 
limit. The main result of this paper is the analytical description of the quasi-equilibria for 
this family of the entropy functions. We have demonstrated that the solutions to the entropy 
maximization problems are accessible in a fairly simple way, and which amounts to studying 
a function of one variable, lma. This makes studies of the non-classical ensembles described 
herein relatively uncomplicated, especially in the vicinity of the classical BGS solutions, 
where we expect, in the first place, the theory to be meaningful. Eventually, predictions can 
be compared in molecular dynamics simulations by making the size of the system smaller, 
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and/or the number of particles smaller. This is left for a future work. 
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